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Objective Excessive worry about minor matters and a state in which this worry is experienced as uncontrollable are known to be key 
symptoms of generalized anxiety disorder (GAD). Given the importance of pathological worry in GAD, the need for psychometrically 
sound measures of this construct has increased. The purpose of this study was to investigate the usefulness of the Korean version of 
Penn State Worry Questionnaire (K-PSWQ) for screening GAD. 

Methods Two hundred and forty six patients were initially screened, from which 102 GAD patients and 118 patients with anxiety dis- 
order not otherwise specified (anxiety disorder NOS) were finally enrolled. Patients were diagnosed by a structured clinical interview for 
the DSM-IV Axis I. We also enrolled 114 control subjects who had no medical or psychiatric history. Pathological worry in both patients 
and control subjects were assessed at baseline using the PSWQ and we estimated optimal cutoff score by the receiver operating charac- 
teristic (ROC) analysis. 

Results We found that in the first ROC analysis, a score of 53 could simultaneously optimize sensitivity and specificity in order to dis- 
criminate GAD patients from control subjects. From the second receiver operating characteristic analysis, when both sensitivity and 
specificity were optimized, we can suggest a score of 61 as being the cutoff for differentiating GAD patients from patients with anxiety 
disorder NOS. 

Conclusion The Korean version of PSWQ is a useful method for screening GAD patients, although ethnic and cultural differences 
may affect the cutoff score of PSWQ for GAD. Psychiatry Investig 201 4; 11 :12-17 

Key Words Generalized anxiety disorder, Worry, Cutoff score, Ethnicity, Receiver operating characteristic analysis. 



INTRODUCTION 

Estimates of the lifetime prevalence rate of generalized anx- 
iety disorder (GAD) in the general population vary between 
3% and 6%.' The third edition of the Diagnostic and Statisti- 
cal Manual of Mental Disorder (DSM-III) denned GAD as 
persistent anxiety, and GAD was most often used as a residual 
diagnosis for individuals who did not meet diagnostic criteria 
for another anxiety disorder. 2 Although the presence of wor- 
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ry was identified as one of GAD symptoms in the DSM-III, in 
subsequent editions, the concept of worry gained increasing 
centrality to the diagnosis of GAD. In the DSM-IV, GAD is 
characterized by chronic, excessive, and uncontrollable worry 
about a variety of topics that has occurred most days over a 
period of at least six months. 

Although worry is associated with all anxiety disorders, ex- 
cessive worrying about minor matters and a sense that this 
worry is uncontrollable have risen as the factors that distin- 
guish worry in GAD from that in other anxiety disorders. 3 
Given the importance of the construct of pathological worry 
in GAD, the need for psychometrically sound measures of this 
construct is increasing. Among several self-report instruments 
that measure worry (i.e., the Worry Domains Questionnaire, 
WDQ; the Student Worry Scale, SWS; the Penn State Worry 
Questionnaire, PSWQ), the PSWQ is the most widely and fre- 
quently used self-report measure for assessing pathological 
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worry in both clinical and non-clinical populations. The PSWQ 
is a 16-item inventory designed to capture the generality, ex- 
cessiveness, and uncontrollability of pathological worry. Indi- 
viduals diagnosed with GAD will have a significantly higher 
score on the PSWQ than do those who have anxiety disorder 
not otherwise specified (anxiety disorder NOS) and other 
anxiety disorders such as social phobia or obsessive-compul- 
sive disorder. 4,5 

The purpose of this study was to investigate the usefulness 
of the Korean version of PSWQ (K-PSWQ) for screening GAD. 
We used ROC analyses between GAD patients and normal 
control subjects and between GAD patients and patients 
with anxiety disorder NOS. 

METHODS 
Subjects 

From the total of 246 patients who were diagnosed as hav- 
ing either GAD or anxiety disorder NOS at the Samsung Medi- 
cal Center from 2008 to 2011, 109 GAD patients and 137 pa- 
tients with anxiety disorder NOS were screened for the study 
via a retrospective chart review. All of these patients were diag- 
nosed by a structured clinical interview for the DSM-IV Axis I 
(SCID-I), administered by trained clinical psychologists. Pa- 
tients with comorbid psychotic disorders or any form of de- 
mentia were excluded from the study. We also excluded indi- 
viduals with Hamilton Anxiety Rating Scale (HAM- A) scores 
of less than 14 in both the GAD and anxiety disorder NOS 
groups since the HAM-A score of less than 14 is generally re- 
garded as the cutoff score for reaching a partial remission state 
of anxiety disorders. 6,7 

Of the 246 patients who were initially screened 102 GAD 
patients and 118 patients with anxiety disorder NOS were fi- 
nally enrolled in the study. More than half of the GAD patients 
(75.49%) met the criteria of one or more comorbid axis-I dis- 
orders. The most common comorbid diagnoses were depres- 
sive disorder (52.33%), dysthymic disorder (23.38%), panic 
disorder (13.75%), somatoform disorder (2.60%), obsessive- 
compulsive disorder (2.60%), and social phobia (2.60%). Also 
more than half of the anxiety disorder NOS patients (56.78%) 
had one or more comorbid axis-I disorders. The most com- 
mon comorbid diagnoses were depressive disorder (46.27%), 
somatoform disorder (13.43%), dysthymic disorder (9.00%), 
and pain disorder (1.50%). 

Considering age and gender of the study subjects, we re- 
cruited normal control subjects through advertisement. The 
control subjects voluntarily agreed to participate in the study 
and a gift card was given to them for their participation. Final- 
ly, we enrolled 114 control subjects who had no medical or 
psychiatric history. Both patients and control subjects gave 



their informed consent after being provided with complete 
information on the study, which was approved by the institu- 
tional review board of Samsung Medical Center. 

Assessment 

The PSWQ is a 16-item self-report scale designed to assess 
the pathological worry construct present in GAD, in which 
each item is scored from 1 (not at all like me) to 5 (very like me). 
The total PSWQ score ranges from 16 to 80, with higher scores 
reflecting higher levels of worry. We used the Korean version 
of PSWQ, which Lim et al. 8 reported to have a high internal 
consistency (0.92). 

The HAM-A is a clinician-rating scale, which consists of 14 
items designed to measure the severity of anxiety symptoms. 9 
The HAM-A consists of two factors: general psychological anx- 
iety symptoms and cognitive symptoms, and its items are rat- 
ed with 4-point Likert scales. The total HAM-A score ranges 
from 0 to 56. 

The BAI is a self-report scale, which includes 21 items de- 
signed to assess the anxiety symptoms over a 1-week period. 10 
Each item is rated with a 4-point Likert scale ranging from 0 
(not at all) to 3 (almost always), and the total BAI score ranges 
from 0 to 63. In this study, we used the Korean version of BAI. 11 

Analysis 

The Statistical Package for Social Science (SPSS) version 
18.0 was used for all statistical analyses, and statistical signifi- 
cance was defined at the 0.05 level (two-tailed tests). Chi- 
square tests were conducted to examine group differences in 
nominal and categorical variables. A Kruskal- Walk's test was 
used as the data were not normally distributed and Mann- 
Whitney U test with Bonferroni correction was used for post- 
hoc analyses. Finally, ROC analyses were conducted to ob- 
tain the cutoff point of the PSWQ for screening GAD when 
considering sensitivity and specificity. 

RESULTS 

General findings 

We found no significant differences in gender, age, educa- 
tion level and socioeconomic and marital status among the 
cUnical samples and control subjects (Table 1). Table 2 shows 
the anxiety levels of patients with GAD and anxiety disorder 
NOS, and those of control subjects. GAD patients showed 
significantly higher scores on the HAM-A (p=0.024) and the 
PSWQ (p<0.001) than did those with anxiety disorder NOS, 
whereas there was no difference in the mean BAI score be- 
tween the two groups. Control subjects showed significantly 
lower scores on the BAI (p<0.001) and the PSWQ (p<0.001) 
than the patients with GAD and anxiety disorder NOS. 
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Table 1 . Demographic characteristics of subjects 







GAD (N= 


=102) 


Anxiety NOS (N=118) 


Controls (N= 


=114) 




M 


SD 


M 


SD 


M 


SD 


r 


Age 




44.84 


16.00 


47.69 


14.44 


41.15 


13.60 


5.799* 






N 


% 


N 


% 


N 


% 


t 


Sex 


Male 


38 


37.3 


44 


37.3 


50 


43.9 


ns 




Female 


64 


62.7 


74 


62.7 


64 


56.1 




Education 


None 


2 


2.0 


4 


3.4 


0 


0.0 


52.446** 




Elementary school 


14 


13.7 


12 


10.2 


0 


0.0 






Middle school 


3 


2.9 


12 


10.2 


5 


4.4 






High school 


47 


46.1 


50 


42.4 


33 


28.9 






College 


6 


5.9 


3 


2.5 


18 


15.8 






University 


28 


27.5 


29 


24.6 


49 


43.0 






Graduate school 


2 


2.0 


8 


6.8 


9 


7.9 




SES 


Lower 


4 


3.9 


3 


2.5 


9 


7.9 


15.573* 




Lower-middle 


15 


14.7 


21 


17.8 


25 


21.9 






Middle 


59 


57.8 


72 


61.0 


68 


59.6 






Middle-upper 


18 


17.6 


12 


10.2 


11 


9.6 






Upper 


6 


5.9 


10 


8.5 


1 


0.9 




Marriage 


Single 


27 


26.5 


26 


22.0 


47 


41.2 


19.314* 




Married 


70 


68.6 


76 


64.4 


61 


53.5 






Remarried 


0 


0.0 


1 


0.8 


0 


0.0 






Separated 


1 


1.0 


2 


1.7 


0 


0.0 






Divorced 


0 


0.0 


4 


3.4 


2 


1.8 






Bereavement 


4 


3.9 


9 


7.6 


4 


3.5 





*p<0.05, **p<0.01. ns: no significant difference, SES: Socio-Economic Status, GAD: Generalized Anxiety Disorder, Anxiety NOS: Anxiety 
disorder not otherwise specified 



Table 2. Mean scores of HAM-A and PSWQ Anxiety in 3 groups 



GAD (N=102) 



Anxiety NOS (N=118) 



Controls (N=114) 





M 


SD 


M 


SD 


M 


SD 


M-WU 


Post hoc 


HAM-A 


19.79 


3.91 


18.70 


3.96 






4960.50* 


1>2 




M 


SD 


M 


SD 


M 


SD 


K-WX 2 


Post hoc 


PSWQ 


63.55 


10.65 


55.42 


11.03 


42.57 


11.11 


129.70*** 


1>2>3 


BAI 


26.50 


10.35 


25.44 


12.12 


7.49 


6.90 


168.93*** 


1=2>3 



*p<0.05, **p<0.01, ***p<0.001. PSWQ: The Perm State Worry Questionnaire, HAM-A: Hamilton Anxiety Rating Scale, BAI: Beck Anxiety 
Inventory, GAD: Generalized Anxiety Disorder, Anxiety NOS: Anxiety Disorder Not Otherwise Specified 



ROC analysis between GAD patients and control 
subjects 

The first set of ROC analyses for the PSWQ score was con- 
ducted to differentiate GAD patients from control subjects. 
As shown in Figure 1, the presence of a good ROC curve sup- 
ported the usefulness of the PSWQ in differentiating GAD 
patients from control subjects (AUC=0.904, p<0.001). Table 
3 also gives support for the sensitivity and specificity of the 
PSWQ and thus supported its usefulness as a screening instru- 
ment for GAD. When optimizing sensitivity, specificity, and 
both sensitivity and specificity, the cut off scores of the PSWQ 



should be 41, 64, and 53, respectively. 

ROC analysis between GAD patients and patients 
with anxiety disorder NOS 

The second set of ROC analyses for the PSWQ score was 
conducted to differentiate GAD patients from patients with 
anxiety disorder NOS. In Figure 2, the good ROC curve sup- 
ported the usefulness of the PSWQ in differentiating GAD pa- 
tients from patients with anxiety disorder NOS (AUC=0.71, p< 
0.001). Table 4 also provides support for the sensitivity and 
specificity of the PSWQ and further supports its usefulness as 
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a screening instrument for GAD. When optimizing sensitivi- 
ty, specificity, and both sensitivity and specificity, the cut off 
scores of the PSWQ should be 57, 64, and 61, respectively. 




l-specificity 

Figure 1. Receiver operating characteristic curve for the utility of 
the Penn State Worry Questionnaire in differentiating Generalized 
Anxiety Disorder patients from control subjects. 



Table 3. Sensitivity and specificity of the PSWQ in GAD patients 
and control subjects 



K-PSWQ score 


Sensitivity 


Specificity 


1-Specificity 


41 


0.961 


0.509 


0.491 


42 


0.961 


0.544 


0.456 


43 


0.961 


0.570 


0.430 


44 


0.951 


0.579 


0.421 


45 


0.941 


0.614 


0.386 


46 


0.931 


0.658 


0.342 


47 


0.931 


0.702 


0.298 


48 


0.892 


0.737 


0.263 


49 


0.892 


0.754 


0.246 


50 


0.873 


0.789 


0.211 


51 


0. 873 


0.807 


0.193 


52 


0.853 


0.807 


0.193 


53 


0.853 


0.825 


0.175 


54 


0.824 


0.860 


0.140 


55 


0.804 


0.877 


0.123 


56 


0.794 


0.886 


0.114 


57 


0.784 


0.904 


0.096 


58 


0.765 


0.912 


0.088 


59 


0.725 


0.912 


0.088 


60 


0.706 


0.921 


0.079 


61 


0.676 


0.930 


0.070 


62 


0.627 


0.939 


0.061 


63 


0.598 


0.939 


0.061 


64 


0.569 


0.939 


0.061 



PSWQ: Penn State Worry Questionnaire, GAD: Generalized Anxi- 
ety Disorder 



DISCUSSION 

The Korean subjects in the present study showed different 
clinical characteristics from those of previous studies that in- 
cluded Caucasian subjects. 12,13 Recently, the applicability of 
the PSWQ as a screening method for GAD has been exam- 
ined by Behar et al. 14 which is the first examination of the 
PSWQ using a ROC analysis. They obtained PSWQ scores 
from treatment-seeking GAD patients as well as non-GAD 
patients and non-anxious control subjects, and suggested a 
PSWQ cutoff score of 45 for differentiating GAD patients 
from non-anxious control subjects and 65 for differentiating 




l-specificity 



Figure 2. Receiver operating characteristic curve for the useful- 
ness of PSWQ in differentiating GAD patients from patients with 
anxiety disorder NOS. PSWQ: Penn State Worry Questionnaire, 
GAD: Generalized Anxiety Disorder, NOS: not otherwise speci- 
fied. 

Table 4. Sensitivity and specificity of the PSWQ in GAD and anxi- 
ety disorder NOS patients 



K-PSWQ score Sensitivity Specificity l-specificity 



53 


0.853 


0.415 


0.585 


54 


0.824 


0.449 


0.551 


55 


0.804 


0.492 


0.508 


56 


0.794 


0.492 


0.508 


57 


0.784 


0.542 


0.458 


58 


0.765 


0.568 


0.432 


59 


0.725 


0.593 


0.407 


60 


0.706 


0.610 


0.390 


61 


0.676 


0.661 


0.339 


62 


0.627 


0.712 


0.288 


63 


0.598 


0.737 


0.263 


64 


0.569 


0.771 


0.229 


65 


0.490 


0.788 


0.212 


66 


0.471 


0.814 


0.186 



PSWQ: Penn State Worry Questionnaire, GAD: Generalized Anxi- 
ety Disorder, NOS: not otherwise specified 
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GAD patients from patients with other anxiety disorders. Their 
non-anxious control subjects had no past or current diagnos- 
able conditions as well as no history of psychotherapy or phar- 
macological treatment. The proposed cut off score of 53 in 
our study seems to be higher than that of the previous study 
including Caucasian subjects. The relatively higher cutoff score 
in our study may result from different control subjects com- 
pared with those in the previous study. As we recruited control 
subjects who had no history of medical or psychiatric condi- 
tions just by thorough history taking, some of them might 
have hidden anxiety disorders. Thus, the mean PSWQ score of 
control subjects in our study was higher than that of the previ- 
ous study, which might lead to the higher PSWQ cutoff score 
for differentiating Korean GAD patients from control subjects. 

Regarding the PSWQ cutoff score of 61 for differentiating 
GAD from other anxiety disorders, our result was relatively 
lower than that of previous studies which proposed a PSWQ 
cutoff score of 65. 13,14 In previous studies, Asian GAD patients 
had higher levels of somatic symptoms and lower levels of psy- 
chological symptoms than American GAD patients, and tend- 
ed to complain of more somatic symptoms such as dizziness 
and indigestion rather than psychological or cognitive symp- 
toms such as worry or nervousness. 15,16 As the PSWQ centers 
on assessing pathological worry symptoms, the Korean GAD 
patients in this study might under-report worry symptoms 
compared with Caucasian GAD patients. These findings sup- 
port that there may be both ethnic and cultural difference in 
the symptomatology of GAD, which might lead to the differ- 
ence in the PSWQ cutoff scores for GAD. 

We also found that GAD patients had higher PSWQ scores 
than patients with anxiety disorder NOS even though there 
was no difference in BAI scores between the two groups. This 
finding suggests that the PSWQ is a useful method for differ- 
entiating GAD from other anxiety disorders. In other words, 
pathological worry, among other general anxiety symptoms, 
should be a core symptom for screening GAD. 

Our study has some limitations. Firstly, it included a retro- 
spective study design and a selection bias might affect inter- 
pretation of the data. To avoid this bias, we included all pa- 
tients who were diagnosed as GAD and anxiety disorder NOS 
in the Samsung Medical Center from 2008 to 2011 in our 
study. Secondly, we did not use any objective measures to 
identify psychiatric illnesses in normal control subjects, al- 
though their anxiety levels measured with the BAI and PSWQ 
were relatively very low. As the prevalence rate of anxiety dis- 
orders is relatively high in a general population, the recruit- 
ment method might lead to some selection bias for making 
control group. Thirdly, as we included only patients with anxi- 
ety disorder NOS in this study, we could not compare the 
PSWQ scores between GAD patients and patients with other 



anxiety disorders such as panic disorder, social phobia, specific 
phobia, or posttraumatic stress disorder. As some symptoms 
of these anxiety disorders also overlap with GAD symptoms, 
this limitation might have hindered this study from obtain- 
ing an optimal cutoff score for GAD. Finally, although GAD 
and anxiety disorder NOS are usually known to be highly co- 
morbid with other mood and anxiety disorders, the comor- 
bidity issue might affect the result of this study. 

In spite of these limitations, this is the first study to examine 
the cut off score of PSWQ for Asian GAD patients, compared 
with patients with anxiety disorder NOS and normal control 
subjects. We can finally conclude that the PSWQ is a useful 
method for screening Asian GAD patients, and PSWQ cutoff 
score for GAD needs to be changed according to the ethnic or 
cultural background of GAD patients. 
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